Visualizing Deep Neural Networks with Topographic Activation Maps
نویسندگان
چکیده
Machine Learning with Deep Neural Networks (DNNs) has become a successful tool in solving tasks across various fields of application. However, the complexity DNNs makes it difficult to understand how they solve their learned task. To improve explainability DNNs, we adapt methods from neuroscience that analyze complex and opaque systems. Here, draw inspiration uses topographic maps visualize brain activity. also activations neurons as maps, research techniques layout two-dimensional space such similar activity are vicinity each other. In this work, introduce compare obtain DNN layer. Moreover, demonstrate use activation identify errors or encoded biases training processes. Our novel visualization technique improves transparency DNN-based decision-making systems is interpretable without expert knowledge Learning.
منابع مشابه
MolMap - Visualizing Molecule Libraries as Topographic Maps
We present a new application for graph drawing and visualization in the context of drug discovery. Combining the scaffold-based cluster hierarchy with molecular similarity graphs — both standard concepts in cheminformatics — allows one to get new insights for analyzing large molecule libraries. The derived clustered graphs represent different aspects of structural similarity. We suggest visuali...
متن کاملDeep Neural Networks with Multistate Activation Functions
We propose multistate activation functions (MSAFs) for deep neural networks (DNNs). These MSAFs are new kinds of activation functions which are capable of representing more than two states, including the N-order MSAFs and the symmetrical MSAF. DNNs with these MSAFs can be trained via conventional Stochastic Gradient Descent (SGD) as well as mean-normalised SGD. We also discuss how these MSAFs p...
متن کاملActivation Ensembles for Deep Neural Networks
Many activation functions have been proposed in the past, but selecting an adequate one requires trial and error. We propose a new methodology of designing activation functions within a neural network at each layer. We call this technique an “activation ensemble” because it allows the use of multiple activation functions at each layer. This is done by introducing additional variables, α, at eac...
متن کاملMatrix learning for topographic neural maps
OF THE DISSERTATION Matrix Learning for Topographic Neural Maps
متن کاملLocal matrix adaptation in topographic neural maps
The self-organizing map (SOM) and neural gas (NG) and generalizations thereof such as the generative topographic map constitute popular algorithms to represent data by means of prototypes arranged on a (hopefully) topology representing map. However, most standard methods rely on the Euclidean metric, hence the resulting clusters are isotropic and they cannot account for local distorsions or cor...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Frontiers in artificial intelligence and applications
سال: 2023
ISSN: ['1879-8314', '0922-6389']
DOI: https://doi.org/10.3233/faia230080